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Abstract 

This  paper  describes  experiments  for  testing  the  power  of  large-scale  resources  for  lexical 
selection  in  machine  translation  (MT)  and  cross-language  information  retrieval  (CLIR). 
We  adopt  the  view  that  verbs  with  similar  argument  structure  share  certain  meaning 
components,  but  that  those  meaning  components  are  more  relevant  to  argument  realiza¬ 
tion  than  to  idiosyncratic  verb  meaning.  We  verify  this  by  demonstrating  that  verbs  with 
similar  argument  structure  as  encoded  in  Lexical  Conceptual  Structure  (LCS)  are  rarely 
synonymous  in  WordNet.  We  then  use  the  results  of  this  work  to  guide  our  implementa¬ 
tion  of  an  algorithm  for  cross-language  selection  of  lexical  items,  exploiting  the  strengths 
of  each  resource:  LCS  for  semantic  structure  and  WordNet  for  semantic  content.  We 
use  the  Parka  Knowledge-Based  System  to  encode  LCS  representations  and  WordNet 
synonym  sets  and  we  implement  our  lexical-selection  algorithm  as  Parka-based  queries 
into  a  knowledge  base  containing  both  information  types. 
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Abstract.  This  paper  describes  experiments  for  testing  the  power  of 
large-scale  resonrces  for  lexical  selection  in  machine  translation  (MT) 
and  cross-langnage  information  retrieval  (CLIR).  We  adopt  the  view 
that  verbs  with  similar  argnment  strnctnre  share  certain  meaning  com¬ 
ponents,  bnt  that  those  meaning  components  are  more  relevant  to  argn¬ 
ment  realization  than  to  idiosyncratic  verb  meaning.  We  verify  this  by 
demonstrating  that  verbs  with  similar  argnment  strnctnre  as  encoded  in 
Lexical  Conceptnal  Strnctnre  (LCS)  are  rarely  synonymons  in  WordNet. 
We  then  nse  the  resnlts  of  this  work  to  gnide  onr  implementation  of 
an  algorithm  for  cross-langnage  selection  of  lexical  items,  exploiting  the 
strengths  of  each  resonrce:  LCS  for  semantic  strnctnre  and  WordNet  for 
semantic  content.  We  nse  the  Parka  Knowledge-Based  System  to  encode 
LCS  representations  and  WordNet  synonym  sets  and  we  implement  onr 
lexical-selection  algorithm  as  Parka-based  qneries  into  a  knowledge  base 
containing  both  information  types. 


1  Introduction 

This  paper  describes  experiments  for  testing  the  power  of  large-scale  resources 
for  lexical  selection  in  machine  translation  (MT)  and  cross-language  information 
retrieval  (CLIR).  We  adopt  the  view  that  verbs  with  similar  argument  structure 
share  certain  meaning  components  [9],  but  that  those  meaning  components  are 
more  relevant  to  argument  realization  than  to  idiosyncratic  verb  meaning.  This 
distinction  mirrors  the  difference  between  semantic  structure,  which  contributes 
to  structural  positioning  of  arguments,  and  semantic  content,  which  is  specific 
to  individual  verb  meaning.^ 

First,  we  verify  the  hypothesis  that  these  two  meaning  types  are  distinct 
by  demonstrating  that  verbs  with  similar  argument  structure  as  encoded  in 
Lexical  Conceptual  Structure  (LCS)  [5,  6,  7]  are  rarely  synonymous  in  WordNet 
[11,  12,  13].  We  then  use  the  results  of  this  work  to  guide  our  implementation  of 

^  See  [10]  for  more  details  about  the  structure/content  dichotomy. 


an  algorithm  for  cross-language  selection  of  lexical  items,  exploiting  the  strengths 
of  each  resource;  LCS  for  semantic  structure  and  WordNet  for  semantic  content. 

We  use  the  Parka  Knowledge-Based  System  [8,  17]  to  encode  LCS  represen¬ 
tations  and  WordNet  synonym  sets  (synsets).^  Our  lexical-selection  algorithm 
is  based  on  Parka-based  queries  into  a  knowledge  base  containing  both  informa¬ 
tion  types.  An  input  source-language  sentence  is  represented  as  a  LCS;  target- 
language  words  are  then  retrieved  using  LCS-based  graph-matching  coupled  with 
further  refinement  by  WordNet  links. 

The  advantage  of  this  approach  is  that  it  provides  a  framework  for  implement¬ 
ing  large-scale  event-based  selection  using  both  information  types.  Event-based 
selection  refers  to  retrieval  on  queries  that  are  verb-based  clauses  (such  as  ‘The 
soldiers  attacked  the  city’)  or  deverbal  noun  phrases  (such  as  ‘The  soldier’s  attack 
on  the  city’).  The  benefit  to  using  both  LCS  and  WordNet  in  event-based  re¬ 
trieval  is  that  the  syntactic  properties  of  a  word  (e.g.,  that  attack  is  a  verb  in  the 
clause  and  a  noun  in  the  deverbal  phrase)  are  suppressed  while  more  relevant 
properties  are  brought  into  focus;  (1)  argument  structure — that  ‘soldier’  and 
‘city’  are  the  primary  components  of  the  attack  event;  and  (2)  meaning — that 
attack  is  closer  in  meaning  to  assault  than  to  criticize.  We  view  the  combination 
of  WordNet  and  LCS  as  a  first  step  toward  evaluating  the  utility  of  these  two 
resources  for  Cross-Language  Information  Retrieval  (CLIR),  a  large-scale  infor¬ 
mation  search  task  in  which  the  query  may  be  posed  in  a  natural  language  that 
is  different  from  that  used  in  the  documents  [3,  4,  14,  15]. 

The  next  section  describes  our  initial  experimentation  to  validate  that  verbs 
with  similar  argument  structure  are  rarely  synonymous.  Section  3  describes  the 
implementation  of  a  lexical-selection  algorithm  that  exploits  this  result.  Section  4 
discusses  the  impact  of  the  LCS-WordNet  combination  on  the  lexical-selection 
task  and  describes  our  future  directions. 

2  Mono-Lingual  and  Cross-Lingual  Validation  of 
Structure/Content  Distinction 

We  have  conducted  experiments  to  verify  the  hypothesis  that  verbs  with  similar 
argument  structure  as  encoded  in  Lexical  Conceptual  Structure  (LCS)  are  rarely 
synonymous  in  WordNet.  Our  experiments  were  run  first  mono-lingually  and 
then  cross-lingually.  An  important  by-product  of  these  experiments  is  that,  by 
inducing  a  reduction  in  ambiguity  for  the  mono- lingual  case,  we  can  achieve 
more  precise  results  in  the  cross-lingual  case.  The  idea  is  that  disambiguation  of 
a  source-language  term  reduces  the  potential  “fan-out”  in  the  target  language, 
thus  achieving  precision  close  to  that  of  the  mono-lingual  case  (as  in  traditional 
single-language  IR  techniques  where  no  linguistic  techniques  are  used). 

We  ran  experiments  with  three  verbs;  sap,  walk,  and  close.  We  constructed 
sentences  and  corresponding  input  LCSs  for  each  case; 

^  Parka  KB  provides  a  very  convenient  mechanism  for  stndying  strnctnral  properties 
of  the  verbs  and  to  implement  fast  searching  techniqnes.  It  also  provides  a  fonndation 
for  handling  large-scale  cross-langnage  resonrces. 


(1)  (i)  He  sapped  my  strength 

[CAUSE 

( [Thing  HE] , 

[GO  Ident 

( [Thing  STREIGTH] , 

[TOWARD  Ident 

( [Thing  STREIGTH] , 

[AT  Ident 

([Thing  STREIGTH],  [Property  SAPPED])])])])] 

(ii)  Florinda  walked  across  the  street 

[GO  Log 

(  [Thing  FLORIIDA] , 

[TOWARD  Log 

( [Thing  FLORIIDA] , 

[ACROSS  Log  ( [Thing  FLORIIDA] ,  [Thing  STREET] )] )] , 
[Manner  WALKIIGLY] )] 

(hi)  He  closed  the  door 

[CAUSE 

( [Thing  HE] , 

[GO  Ident 

( [Thing  DOOR] , 

[TOWARD  Ident 
( [Thing  DOOR] , 

[AT  Ident 

([Thing  DOOR],  [Property  CLOSED])])])])] 

In  each  of  these  cases,  the  semantic  structure  is  encoded  in  the  argument  struc¬ 
ture  itself,  e.g.,  the  primitive  GO  takes  as  its  two  arguments  a  Thing  (DOOR) 
and  a  Path  (TOWARD).  The  semantic  content  is  encoded  as  a  LCS  constant, 
respectively;  SAPPED,  WALKINGLY,  and  GLOSED. 

Our  experiments  were  run  first  on  an  English  database  of  54,000  LGS  entries 
that  includes  verbs,  nouns,  adjectives,  and  prepositions.  Using  a  relaxed  version 
of  the  graph-matching  technique  described  in  [3,  4],  we  ignored  constant  posi¬ 
tions  and  extracted  only  those  LGSs  that  structurally  matched  the  input  LGS. 
Gonsider  the  verb  sap.  Out  of  54,000  LGSs,  only  149  match  the  LGS  in  (li). 
These  include  verbs  like  clean,  clear,  drain,  empty,  etc.  We  then  checked  the 
synonymy  relation  in  WordNet  for  these  graph-matched  verbs.  The  verb  sap,  as 
used  in  the  LGS  above,  corresponds  to  synset  00657546.^  The  only  verbs  among 
the  149  graph-matched  verbs  in  this  synset  are  sap  itself  and  drain.  Thus,  for 
this  case,  we  found  that  semantic-structure/semantic-content  overlap  occurred 
in  only  2  out  of  the  149  cases  (including  sap  itself). 

The  full  set  of  results  for  sap,  walk,  and  close  are  given  in  Table  1.  Note 

^  The  synset  numbers  are  taken  from  Version  1.5  of  WordNet,  available  at 
http://www.cogsci.princeton.edu/"^ wn.  Synset  numbers  were  assigned  to  LCS  tem¬ 
plates  by  hand:  each  template  was  human-annotated  with  as  many  WordNet  synsets 
as  were  applicable.  (See  [1]  for  more  details.) 


Verb 

Synset  (s) 

Graph-Matched 

Same  Synset 

sap 

00657546 

149:  clean,  clear,  drain, 
empty,  erase,  rednce,.  .  . 

2:  drain,  sap 

walk 

01086212 

01089891 

01116106 

01086031 

272:  amble, 

approach,  creep,  go,  leave, 
sannter,.  .  . 

1:  walk 

close 

00772512 

00773754 

918:  collapse,  fold,  shnt, 
smooth,  split,.  .  . 

2:  close,  shnt 

Table  1.  Mono-Lingual  Generation  of  Matching  Terms 


that  in  each  case,  the  number  of  graph-matched  possibilities  is  radically  reduced 
(918  down  to  2  in  the  case  of  close),  thus  supporting  our  hypothesis  that  the 
overlap  between  semantic  structure  and  semantic  content  is  rare.  The  two  cases 
where  there  is  more  than  one  overlapping  verb  (  drain  overlaps  with  sap  and  shut 
overlaps  with  close)  are  true  cases  of  syntactic  and  semantic  interchangeability 
with  respect  to  their  usage  in  the  examples  given  in  (1). 

In  our  cross-lingual  experiment,  we  ran  the  same  algorithm  on  the  three  LCSs 
above  to  produce  Spanish  target-language  equivalents.  Our  Spanish  LCS  lexicon 
has  approximately  40,000  LCSs  and,  as  in  English,  each  entry  human-annotated 
with  as  many  WordNet  synsets  as  were  applicable.^  The  results  in  Table  2  show 
that  we  were  able  to  restrict  the  fan-out  from  Spanish  to  English  words  at  least 
as  well  as  in  the  mono-lingual  (English-to-English)  case. 

We  undertook  additional  experimentation  with  WordNet  to  determine  if  it 
would  be  reasonable  to  produce  more  target-language  candidates,  e.g.,  one  link 
away  (hypernymy)  from  each  verb’s  synset.  We  found  that  the  candidate  set 
did  not  grow  drastically;  one  additional  term  for  sap  (reducir  =  reduce)  and 
one  additional  term  for  close  (tornar  =  change).  Eurther  investigation  would 
be  required  to  determine  the  usefulness  of  terms  generated  using  other  types  of 
links  (e.g.,  hyponymy,  troponymy)  as  well  as  different  distances  from  the  matched 
target-language  candidate.  Measures  of  success  would  presumably  vary  on  the 
application;  MT  would,  perhaps,  require  more  refined  matching  than  CLIR.  In 
the  next  section,  we  will  examine  cases  where  the  one-link  (hypernym)  approach 
is  used  to  select  target-language  terms  in  cases  where  no  synsets  match  those  of 
the  source-language  term. 


^  Unlike  the  English,  the  Spanish  LCS  lexicon  inclndes  only  verbs  and  nonns  (which 
is  the  reason  for  the  size  discrepancy),  bnt  this  difference  is  inconseqnential  for 
the  event-based  experiments  reported  here.  See  [2]  for  more  details  regarding  the 
annotation  of  Spanish  verbs  with  WordNet  synsets. 


Verb 

Synset(s) 

G  raph- Mat  died 

Same  Synset 

sap 

00657546 

358:  agotar,  desagnar,  es- 
cnrrir,  evacnar,  redncir,  va- 
ciar,  zapar,.  . . 

1:  escnrrir 

walk 

01086212 

01089891 

01116106 

01086031 

136:  andar,  caminar,  cor- 
rer,  ir,  pasear,. . . 

2:  andar, caminar 

close 

00772512 

00773754 

1554:  alterar, 

cerrar,  clansnrar,  conclnir, 
convertir,  disminnir,  sepa- 
rar,  tapar,  virar,.  .  . 

4:  cerrar,  clansnrar,  con¬ 
clnir,  tapar 

Table  2.  Cross-Lingual  Generation  of  Matching  Terms 


3  Implementation  of  Lexical  Selection  Algorithm 

Having  tested  the  utility  of  accessing  semantic  content  independently  from  se¬ 
mantic  structure,  we  have  implemented  an  algorithm  for  cross-language  selection 
of  lexical  items,  exploiting  the  strengths  of  each  resource;  LCS  for  semantic  struc¬ 
ture  and  WordNet  for  semantic  content.  We  use  the  Parka  Knowledge-Based 
System  to  encode  LCS  representations  and  WordNet  synonym  sets  and  we  im¬ 
plement  our  lexical-selection  algorithm  as  Parka-based  queries  into  a  knowledge 
base  containing  both  information  types. 

Parka  is  a  frame-based  knowledge  representation  that  is  intended  to  provide 
extremely  fast  inferences  and  accommodate  very  large  knowledge  bases  (KBs), 
on  the  order  of  millions  of  frames.  Frames  are  used  to  specify  categories,  in¬ 
stances,  and  predicates  to  Parka.  Predicates  represent  relations  among  entities. 
The  relations  being  used  in  our  algorithm  are  binary  predicates.  We  created  two 
tools,  one  for  converting  files  with  LCSs  into  Parka-based  assertions  and  one  for 
updating  the  KB  (adding  new  LCSs).  We  have  built  Parka  KBs  for  the  entire 
English  and  Spanish  lexicons.  We  also  have  transferred  all  the  definitions  from 
the  English  and  Spanish  WordNets  into  Parka-WNet  KB. 

The  basic  procedure  on  the  graph-matching  (structural)  level  is  the  follow¬ 
ing;  Given  a  composed  LCS  for  a  source-language  sentence,  extract  all  possible 
LCSs  whose  structure  covers  that  of  the  composed  LCS  except  for  the  constant 
position.  We  implement  this  procedure  by  processing  the  query  on  each  tree  level 
of  an  LCS  representation.  Queries  are  designed  to  capture  only  the  structural 
properties  of  a  LCS. 

Consider  example  (lii)  given  earlier.  The  LCS  entry  for  the  word  walk  is 
shown  here;® 

®  The  [AT]  node  is  a  generic  positional  primitive  that  matches  any  nnmber  of  other 
positional  primitives  snch  as  ACROSS,  OVER,  etc. 


(2)  [GO  Loc 

( [Thing  X] , 

[TOWARD  Loc  ([Thing  X],  [[AT]  Loc  ([Thing  X],  [Thing  Y])])], 
[Manner  WALKIIGLY])] 

At  the  highest  level,  the  GO  Loc  node,  there  are  1059  matching  LCSs  in  the 
lexicon.  For  example,  the  verb  swim  shares  this  node  with  walk.  Moving  to  the 
next  node  level,  there  are  4399  matches  (because  all  possible  matches  on  two 
levels  are  included  for  each  LCS  candidate),  but  the  number  of  possible  words 
has  decreased.  In  general,  the  algorithm  processes  the  effective  query  which  is 
optimally  constructed  for  each  LCS  tree.  It  extracts  all  the  structural  matches 
of  the  source  LCS  on  all  the  tree  levels.®  Finally,  the  graph-matching  procedure 
extracts  the  matching  target-language  words.  In  the  case  of  walk,  there  are  272 
candidates  as  was  indicated  in  earlier  in  Table  1. 

In  order  to  further  reduce  this  set,  we  use  WordNet  as  the  basis  of  a  more 
refined  lexical  selection.  For  example,  suppose  we  are  trying  to  eliminate  correr 
(=  run)  as  a  target-language  candidate.  We  use  WordNet  to  check  for  similarity 
between  runningly  and  walkingly  (or,  more  precisely,  the  lexemes  themselves; 
run  and  walk).  Because  run  is  not  in  any  of  the  synsets  containing  walk,  the 
verb  correr  is  ruled  out.  By  contrast,  the  verbs  andar  and  caminar  are  in  synsets 
that  include  walk  (both  occur  in  01086212  and  01086031),  so  these  two  verbs 
are  selected  as  a  match. 

In  addition  to  cases  where  target-language  terms  occur  in  the  appropriate 
synset(s),  we  also  examined  cases  where  no  synsets  match  those  of  the  source- 
language  term.  There  are  two  such  cases,  one  in  which  there  is  a  LCS  that 
matches  exactly  (both  in  structure  and  in  content)  and  one  in  which  there  is 
no  LCS  that  matches  exactly  (i.e.,  the  structure  matches,  but  not  the  content). 
Thus,  including  the  case  where  there  are  matching  synsets,  there  are  three  cases 
to  consider; 

1.  If  the  LCS  matches  exactly  and  there  are  shared  synsets,  return  matching 
words  with  shared  synsets.  For  example  return  escurrir  for  sap;  andar,  cam¬ 
inar  for  walk]  and  cerrar,  clausurar,  concluir,  tapar  for  close. 

2.  If  the  LCS  matches  exactly  and  there  are  no  shared  synsets,  return  words 
that  match  exactly.  For  example,  return  fortalecer,  forialecerse,  and  confir- 
mar  for  strengthen. 

3.  If  the  LCS  does  not  match  in  content,  return  one-link  hypernyms  of  struc¬ 
turally  matching  words.  For  example,  return  retr  and  reirse  for  giggle. 

In  the  last  case  above,  we  determine  the  closeness  of  semantic  content  using  an 
information-content  metric  approach  (cf.,  [16]),  i.e.  selecting  those  words  with  the 
shortest  (weighted)  distance  in  WordNet  between  the  mismatched  LCS  constant 

®  Theoretically,  Parka  provides  utilities  to  process  N-level  queries,  where  N  is  the  depth 
of  the  LCS  tree.  However,  due  to  memory  limitations,  large-scale  application  of  our 
algorithm  requires  that  we  restrict  the  number  of  levels.  Thus,  at  each  recursive  tree 
level,  we  limit  our  processing  to  one-  or  two-level  queries. 


and  the  corresponding  lexemes.  As  a  first  approximation  to  this,  we  used  the 
one-link  (hypernym)  approach  to  select  target-language  terms. ^ 

Consider  the  following  examples  corresponding  to  the  last  two  cases  above; 

(3)  She  strengthened  her  muscles 

[CAUSE 

( [Thing  SHE] , 

[GO  Ident 

( [Thing  MUSCLE] , 

[TOWARD  Ident 

( [Thing  MUSCLE] , 

[AT  Ident  ([Thing  MUSCLE],  [Property  STREIGTHEIED] )])])]  )] 

(4)  Mary  giggled  at  the  dog 

[CAUSE 

( [Thing  DOG] , 

[GO  Perc 

( [Thing  MARY] , 

[TOWARD  Perc 

( [Thing  MARY] , 

[AT  Perc  ( [Thing  MARY] ,  [Thing  DOG] )] )] )]  , 

[Manner  GIGGLIIGLY] )] 

There  are  1554  LCSs  in  the  Spanish  lexicon  that  match  the  composed  LCS 
structurally  in  (3).  However,  none  of  these  correspond  to  words  that  share  the 
synsets  (00131909  and  00132257)  associated  with  strengthen  in  the  composed 
LCS.  Thus,  we  select  only  those  words  whose  lexical  entry  matches  the  com¬ 
posed  LCS  exactly,  both  in  structure  and  in  content  (i.e.,  including  the  constant 
STREIGTHEIED).  The  three  words  that  match  exactly  are  confirmar  (=  confirm), 
fortalecer  (=  fortify),  and  fortalecerse  (=  fortify  oneself). 

In  the  case  of  (4),  there  are  36  LCSs  in  the  Spanish  lexicon  that  match  the 
composed  LCS  in  structure  (but  not  in  content).  Some  examples  are;  bufar  (= 
snort),  cacarear  (=  cackle),  gritar  (=  howl),  jadear  (=  gasp),  reir  (=  laugh), 
reirse  (=  laugh  over),  and  sonreir  (=  smile).  However,  only  reir  and  reirse 
correspond  to  words  that  share  the  synset  (00020446)  which  is  a  hypernym  (one 
link  away)  of  the  set  associated  with  giggle  in  the  composed  LCS;  thus,  these 
two  words  are  selected. 

A  summary  of  the  last  two  cases  is  shown  in  Table  3 

4  Conclusions  and  Future  Work 

We  have  demonstrated  that  verbs  with  similar  argument  structure  as  encoded 
in  LCS  are  rarely  synonymous  in  WordNet.  We  exploit  this  result  in  the  task 

^  Hypernym  links  tie  a  word  to  its  more  general  connterpart,  e.g.,  laugh  is  a  hypernym 
of  cackle. 


Verb 

Synset  (s) 

G  raph- Mat  died 

Same  Synset 

strengthen 

00131909 

00132257 

1554: 

alterar,  confirmar,  fortale- 
cer,  fortalecerse,  modificar, 
tornar,. .  . 

Exact:  confirmar,  fortale- 
cer,  fortalecerse 

0:— 

giggle 

00019651 

36:  bnfar,  cacarear,  gri- 
tar,  jadear,  rei'r,  reirse, 
sonrei'r, .  .  . 

0:— 

One  link  away:  reir  rei'rse 

Table  3.  Generation  of  Verbs  with  no  Matching  WordNet  Synsets 


of  lexical  selection,  using  LCS  graph-matching  to  determine  the  closeness  of 
semantic  structure  (argument  structure  in  the  LCS  for  the  events)  and  WordNet 
links  to  determine  the  closeness  of  the  semantic  content  (the  constant  in  the 
LCS  for  verbs). 

The  combination  of  LCS  and  WordNet  allows  us  to  cover  a  variety  of  different 
cases  that  otherwise  would  not  be  handled  by  either  knowledge  source  alone. 
In  particular,  we  have  shown  that  there  are  cases  where  LCS  graph-matching 
alone  is  sufhcient  for  selecting  target-language  terms,  e.g.,  for  strengthen,  where 
WordNet  does  not  provide  a  synset-based  equivalent  in  Spanish.  We  have  also 
shown  that  there  are  cases  where  WordNet  is  critical  to  the  final  selection  of 
target-language  terms,  e.g.,  for  walk,  where  numerous  exactly  matched  LCSs  in 
Spanish  can  restricted  by  a  handful  of  shared  WordNet  synsets,  and  for  giggle, 
where  there  are  no  exactly  matched  LCSs  in  Spanish  but  there  exists  a  small  set 
of  related  WordNet  synsets. 

Our  future  work  will  generalize  the  one-link  synset  matching  by  integrating  a 
probabilistic  technique  based  on  insights  from  [16],  which  focuses  on  nouns.  We 
will  implement  an  analogous  information-content  metric  method  for  verbs  using 
Parka  utilities.  We  will  then  extend  this  combined  approach  to  the  task  of  noun 
selection.  This  will  involve  construction  of  a  probabilistic  mapping  from  Spanish 
nouns  (taken  from  a  Kimmo-based  lexicon)  and  WordNet  senses.  We  expect 
nouns  and  verbs  to  be  characteristically  opposed  in  their  requirements  with 
respect  to  the  resources  we  use.  In  particular,  WordNet  is  hierarchically  shallow 
for  verbs,  but  this  is  counter-balanced  by  the  richness  in  argument  structure 
provided  by  the  LCSs.  In  contrast,  LCSs  are  shallow  for  nouns,  but  this  is 
counter-balanced  by  the  deep  hierarchical  structure  of  nouns  in  WordNet. 
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